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SPARSE MAXIMUM LIKELIHOOD DECODER FOR BLOCK CODES 



Background of the Invention 

5 1. Field of the Invention 

This invention relates generally to wireless data communications, and more 
specifically to a method of substantially improving error correction capability of block 
codes in desired data communication applications. 

10 2. Description of the Prior Art 

In Third Generation Partnership Project (3 GPP), the transport format combination 
indicator (TFCI) is used for properly decoding the received data. The TFCI indicates one 
of the choices, namely, one of the transport format combinations regarding how to 
15 decode the channel bits. The Node-B (base station) informs the mobile station of the set 
of available transport format combinations. The TFCI determines coding type, CRC bits, 
transport block size, etc. Without the proper TFCI, the decoded data will most certainly 
fail CRC and the transmission will be counted as a block error. The TFCI field is 
encoded by using a Reed Muller code to protect it. 

20 

Figure 1 shows the frame structure 10 for a downlink dedicated physical channel 
(DPCH). Depending on the slot format, there may be anywhere from 0 to 8 TFCI bits per 
slot in normal mode, or 0 to 16 bits per slot in compressed mode. This results in 0 to 120 
bits for TFCI in a frame. Whenever the number of TFCI bits after encoding exceed or are 

25 less than the number of available TFCI bits in a frame, the TFCI bits are punctured or 
repeated, respectively. In the case of normal or logical split TFCI mode, the TFCI is 
encoded using a (32,10) Reed Muller code. The encoding procedure 20 is shown below 
in Figure 2. In case of split TFCI using hard split, the TFCI for the DPCH and Downlink 
Shared Channel (DSCH) channels are encoded separately using a (16,5) bi-orthogonal 

30 code. Figure 2 shows the encoder block diagram for the Normal mode. 
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The reception of the TFCI is critical to proper operation of the user equipment 
(UE). Whenever the TFC is received with an error, data for the corresponding 
transmission time interval (TTI) are most likely to be discarded. For 80 ms TTI, that is 
the data that has been received over the last 8 frames and translates into large chunks of 

5 data being lost. One current universal mobile telecom system (UMTS) chipset uses the 
Green Machine disclosed by F J. Mac Williams and N.J. A. Sloane, The theory of Error- 
Correcting Codes, North-Holland, Amsterdam, 1977, to decode the encoded data 
transmitted by the UTRAN. In this report, a technique is proposed to improve the 
performance of the TFC decoder using an alternate approach. Although this technique is 

10 used to decode Reed Muller encoded data, it can be easily extended to other codes 
whenever all the code words of a code are not used. 

The Green Machine decoder is used to decode Reed-Muller (RM) encoded data as 
stated herein before. The green machine is an approach to decode RM codes using Walsh 
15 Hadamard Transforms. In this approach, the decoder searches for the decoded data 
among all the code words even if a large subset of these code words is not used. In 
addition, the basis vectors for the RM code need to be saved in memory along with 
intermediate summation results to decode the data properly. The block diagram of the 
green machine decoder structure 30 is shown in Figure 3. 

20 

Another approach used in the prior art is the generator matrix approach that uses a 
hard decision approach to carry out syndrome testing such as disclosed by Proakis, John 
G., Digital communications, McGraw-Hill, Inc., 1995. 

25 In U.S. Patent No. 6,341,125, entitled Method for improving TFCI transportation 

performance, by Hong, Sung Kwon, et al., issued January 22, 2002, an attempt is made 
to improve the encoder to transmit TFCI with a low BER. In any of the above, no 
attempt is made to improve the decoder's performance or to provide more protection to 
the transmitted bits. 

30 
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In view of the foregoing, it would be both advantageous and desirable in the 
wireless data communication art to provide a method that is independent of the encoder 
and that can be used to decode data encoded by any block code in a manner that 
substantially improves the error correction capability of the block codes. It would be 

5 further advantageous and desirable if the structure associated with the method could 
allow the testing of those hypotheses that are known to exist, such that one can use the a 
priori knowledge of the possible set of hypotheses to only search from among them. 
Such a method would also be advantageous and desirable since knowing the subset of the 
code word space that is being utilized in essence allows the distance between the code 

10 words to be increased yielding significant decoding benefits. 
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Summary of the Invention 

The present invention is directed to a method that can be used to decode data 
encoded by any block code in a manner that substantially improves the error correction 
5 capability of the block codes, and that is independent of the encoder. UE is informed of 
the TFCS by higher layer signaling. Embodiments of the invention are described in the 
Universal Mobile Telephone System (UMTS) without restricting the invention to such. 
A UMTS terrestrial radio access network (UTRAN) informs the UE of all possible TFCIs 
by an "information element" (IE) called "Transport Format Combination Set". This is 

10 listed in 10.3.5.20 of TS25.331 of the 3 GPP specification. The structure associated with 
the method desirably allows the testing of those hypotheses that are known to exist, such 
that one can use the a priori knowledge of the possible set of hypotheses to only search 
from among them. The method of decoding data is advantageous and desirable since 
knowing the subset of the code word space that is being utilized in essence allows the 

15 distance between the code words to be increased yielding significant decoding benefits. 

According to one embodiment, a method of decoding a block code comprises the 
steps of: 

20 providing a Maximum Likelihood (ML) sparse decoder; and 

decoding solely the a priori information of the code space subset used. 

According to another embodiment, a maximum likelihood (ML) sparse decoder 
for block codes comprises: 
25 a hypothesis generator operational to iterate over all possible values of a 

predetermined transport format combination indicator (TFCI).; 

a code word generator operational to generate a corresponding encoded TFCI for 
the hypothesis that is being decoded in a desired iteration; 

a correlator operational to correlate the corresponding encoded TFCI to the soft 
30 output of an associated rake receiver; and 
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a maximum finder operational to compare the correlation result for the current 
iteration with that of the immediately previous iteration to determine the most correlated 
hypothesis. 

According to yet another embodiment, a maximum likelihood (ML) sparse 
5 decoder for block codes comprises: 

means for iterating over all possible values of a transport format combination 
indicator (TFCI); 

means for generating a corresponding encoded TFCI for a hypothesis that is being 
decoded in a desired iteration; 
10 means for correlating the corresponding encoded TFCI to the soft output of an 

associated rake receiver; and / 

means for comparing the correlation result for the current iteration with that of the 
immediately previous iteration to determine the most correlated hypothesis. 
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Brief Description of the Drawines 

Other aspects and features of the present invention and many of the attendant 
advantages of the present invention will be readily appreciated as the aspects and features 
5 become better understood by reference to the following detailed description when 
considered in connection with the accompanying drawings in which like reference 
numerals designate like parts throughout the figures thereof and wherein: 



10 



Figure 1 depicts a frame structure for downlink DPCH; 

Figure 2 is a block diagram illustrating a TFCI encoding procedure; 

Figure 3 illustrates a Green Machine decoder structure; 



15 Figures 4a and 4b depict a diagram illustrating a sparse decoder implementation 

for the (32, 10) Reed Muller Code; 

Figures 5a - 5e show plots illustrating performance comparisons between a Green 
Machine Decoder and a decoder implemented in accordance with particular embodiments 
20 of the present invention for a TFCS size = 128, 64, 32, 16 and 8 respectively for slot 
format 13, 14 and 15; 

Figure 5f is a graph illustrating gain comparisons between a Green Machine 
Decoder and a decoder due to use of a sparse decoder implemented in accordance with 
25 particular embodiments of the present invention for various TFCS sizes; 

Figure 6 is a graph depicting plots showing the performance of the Green 
Machine Decoder with a known TFCS size = 8 for slot format 13, 14 and 15; 
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Figures 7a - 7c show plots illustrating simulation results for TFCI decoding using 
various approaches for the reliability measure (20ms, 40ms and 80ms respectively) in 
association with a method according to one embodiment of the present invention; 

5 Figure 8 illustrates a TFCI encoding procedure employed in 3 GPP Release-5, for 

flexible hard split mode; 

Figure 9 is a diagram illustrating a ML sparse decoder adapted to accommodate 
the Release-5 version of the 3GPP standard; and 

10 

Figure 10 is a graph illustrating the weight distribution for the (32, 10) Reed 
Muller code. 

While the above-identified drawing figures set forth alternative embodiments, 
15 other embodiments of the present invention are also contemplated, as noted in the 

discussion. In all cases, this disclosure presents illustrated embodiments of the present 
invention by way of representation and not limitation. Numerous other modifications and 
embodiments can be devised by those skilled in the art which fall within the scope and 
spirit of the principles of this invention. 
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Detailed Description of the Preferred Embodiments 

The techniques described herein below substantially improve the sparse decoder 
error free detection probability, as stated herein before. The encoder is not modified in 

5 any way, although the decoder's ability to decode is improved significantly. The present 
inventors exploited the fact that most of the time the code word space is not fully utilized 
in some applications. Based on the 10-bit TFCI, there can be 1024 possible TFCIs; but 
this large number is never used, and in fact usually it is much less than that number. A 
maximum likelihood decoding approach was employed for the code words that are 

10 known to be used. This can be done for a user equipment (UE) in normal use, because in 
most cases the TFCS (Transport Format Combination Set) size is significantly smaller 
than the maximum TFCS size supported. The Node-B signals the TFCS size to the UE. 
Since the TFCS size is known, the approach described herein below allows its use to 
improve the decoder's performance. 

15 

Sparse Decoder Implementation for the (32, 10) Bi-orthogonal Code 

Looking now at Figure 4, a diagram illustrates a sparse decoder 100 
implementation for the (32, 10) Reed Muller Code in accordance with one embodiment 
of the present invention. Given the TFCS size, the "Hypothesis Generator" 102 iterates 

20 over all the possible values of the TFCI. Usually this number will be pretty small and 
that is where this decoder 100 structure will yield the most benefit in terms of 
performance improvement and power savings described in more detail herein below. The 
case where the size of the TFCS is equal to 1024 (maximum possible) is only in the case 
of a logically split TFCI. This is the case when a DPCH channel in addition to a DSCH 

25 channel is used and the TFCI of both the channels is transmitted over the downlink 
DPCCH. In this scenario, the 5-bit TFCI of the DPCH is concatenated with the 5-bit 
TFCI of the DSCH channel and then the 10-bits are encoded using the (32,10) Reed 
Muller code. 

30 The "Code Word Generator" 104 block generates the corresponding encoded 32- 

bit TFCI for the hypothesis that is being tested in the given iteration. It is interesting to 
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note that this block is the encoder section that may already exist in the transmitter 
hardware, and can be reused easily because the user equipment uses the same code to 
transmit the TFCI back to the Node B. The basis vectors are given below in Table 1 
below. 

5 



Table 1: Basis sequences for (32,10) TFCI code 
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The "Correlator" 106 block takes the generated hypothesis and correlates it to the 5-bit 
soft output of the rake receiver. Since the output of the "Code Word Generator" 104 is 
10 just zeros and ones, the correlator bank can be implemented as multiplexers where the 
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encoded bit acts as the control signal. The results of the 32 correlations are then added in 
the summer 108. A sign inverter and a multiplexer are equivalent to a multiplier by +1 or 
-1; and the correlation is the sum of those products. This correlation is a measure of the 
confidence in the decoded result. The utility of this reliability measure is discussed 
5 further herein below. 

The "Maximum Finder" 110 simply compares the correlation result for the current 
iteration with that of the previous iteration. In the case of the first iteration the 
correlation result is compared with 0. The circuit 1 10 can be seen to extract the sign bit 
10 of the result of the comparison. If it is logic ' V then that means that the particular 

hypothesis that is being tested is most correlated with the received TFCI bits coming out 
of the rake receiver. Hence, the hypothesis that is being tested and the correlation result 
are written to the memory 112. For the next hypothesis, this stored result is used for 
comparison and so on. 

15 

Sparse Decoder Implementation for the (16,5) Bi-orthogonal Code 

The present inventors recognized the structure shown in Figure 4 can be made 
flexible enough to readily support the (16,5) Reed Muller code in addition to the (32,10) 
code. The basis vectors for the (16,5) code will be used in such a scenario and the 
20 decoder will be run twice to decode both the TFCIs, one for the DPCH channel and the 
other for the DSCH channel. The basis vectors for this code are shown in Table 2 below. 
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Table 2: Basis sequences for (16,5) TFCI code. 
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Logical Split Mode Handling 

In this mode, the TFCIs for the DPCH and DSCH are concatenated prior to being 

5 encoded using the (32,10) Reed Muller code. If both the DPCH and DSCH TFCI 
channels are using the maximum size, then that forms the most likely scenario where 
there might be a need to run the sparse decoder 100 through all the 1024 hypotheses. In 
the case where the DPCH channel and DSCH channel don't use the maximum possible 
TFCS size, then based on the 5-bits allocated for the TFCI in this mode, one can still use 

10 the TFCS information for both DPCH and DSCH. In this case, one uses the 

TFCSsize D pcH and TFCSsize D scH, converts them to binary numbers and concatenates the 
two 5-bit binary numbers to form a 10-bit TFCI number, and then changes it to a decimal. 
The "Max TFCS size" in the Hypothesis Generator 102 can be set to this number to 
decode the concatenated TFCIs. One such procedure is detailed below as follows: 



binary (TFCSsize DPC H) = [ao ai a 2 a 3 84] 

binary (TFCSsize D scH) = [bo bi b 2 b 3 b 4 ] 

Set "Max TFCS size" = decimal(ao ai a 2 a 3 a4b 0 bi b 2 b 3 b 4 ) 
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The present invention is not so limited however; and alternatively, the Hypothesis 
Generator 102 may store all the possible codes instead of storing Max TFCS size. 

The present inventors found that whenever the TFCS size is smaller than the 
5 maximum size, the performance of the sparse decoder 100 is better than that of other 
decoders. In the case when the maximum possible TFCS size (for which there is no 
known scenario except logical split mode) is used, the performance was found to be just 
as good as the Green Machine or any other decoder. If the TFCS signaled to the UE by 
the UTRAN is equal to 128, then the idea is to correlate the code words that relate to 1- 
10 128 TFCIs with the received TFCI code word; and the correlation that yields the largest 
value is the one that is the decoded TFCI. The maximum likelihood decoder is optimum. 
The net affect of limiting the code space used is that the resulting distance between the 
code words used increases thus yielding better decoding capability. 

15 Figures 5a - 5e show plots illustrating performance comparisons between a Green 

Machine Decoder and a decoder implemented in accordance with particular embodiments 
of the present invention described herein before. Results are shown for various cases 
where the maximum TFCS size is limited to less than the maximum size. With the TFCS 
size at 8 there is a 3.5 dB improvement over the performance of the Green Decoder. In 

20 the case of larger TFCS sizes such as 128 and 64, the improvement is 1 .4 dB and 1 .85 dB 
respectively. In the case of PCH (paging channel), the TFCI size can be even smaller 
yielding even higher gains. These are very significant improvements. 

A UE using the sparse decoder 100 will have significantly better reception than 
25 one that is not using it. It can be appreciated this design will then translate into better 
reception or voice quality, fewer dropped calls and lower probabilities of missed pages 
than other approaches known in the art. Figure 5 (f) shows the gain due to the sparse 
decoder 100 for various TFCS sizes over the Green Machine decoder. The performance 
gain in dB means the reduction in base station transmit power for the same quality. This 
30 power reduction translates to network capacity increase in the CDMA system(s). 
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Those skilled in the art will recognized that a linear bock code can be viewed as a 
n-tuple vector space. A code can be seen as a point in this space where the hamming 
distance (measure of the difference between code words; and it is equal to the number of 
corresponding elements or positions in which two code words differ) from the closest 
5 neighbor translates into the error correcting capability of the code. When the code is 
limited such that not all the code words are allowed, then in essence one increases the 
hamming distance of the code and hence its error correcting ability. This can be viewed 
as making the vector space sparse. 

10 It is known that for a linear block code, the minimum distance is given by: 

rf m in = min {w r }, where w r denotes the weight of the r-th code word. 

If we look at the minimum Hamming distance of the (32, 10) Reed Muller code, shown in 
Table 3 below, we notice that the minimum weight apart from the all 0 code word is 12. 
Then from the above equation, the minimum distance of the code is 12. As we limit the 
15 number of code words allowed, two factors come into play that improve the decoder 100 
performance: 

1) The minimum hamming distance of the resultant code increases; and 

2) The hamming distance between individual code words increases. This is 
evident from Figure 5. 

20 



Table 3: Minimum hamming weight of the code as the TFCS size is restricted. 
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The present inventors also studied the possibility of using the TFCS size information for 
the Green Machine decoder. The plot shown in Figure 6 is for the case where the TFCS 
25 size is 8. After decoding by Green Machine, 7 bits are ignored since they are known to 
be zero because we need only 3 bits to represent the TFCS size of 8. There is a minute 
improvement; but unlike the sparse decoder 100, the Green Machine decoder cannot 
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improve the performance by any significant margin. In the best case at low Eb/No, the 
improvement is about 0.5 dB compared with 3.5 dB in the case of the sparse decoder 100. 
The improvement applies for the case where only the ignored bits are in error and none of 
the other bits are received with any error. 

5 

Reliability Measure to improve TFCI decoding for longer TTIs 

As the decoder 100 runs through all the hypotheses, starting from TFCI = 0 to the 
max TFCI, the results of the correlation are compared with the results of the previous 
hypothesis. Each time the new correlation results exceed the previous highest result, the 

10 corresponding TFCI is saved along with the correlation result. The correlation result is 
an indicator of the confidence in the decoded TFCI. This can be very useful in the case 
where a block is being decoded that is more than the minimum TTI (Transmission Time 
Interval) size. In this case, the TFCI is received every frame or every 10 msec. In 
UMTS, there can be a 10,20,40 or 80 ms TTL In the case of 80 ms TTI, 8 different 

15 TFCIs are decoded over the 80ms before the data is decoded. If the received TFCIs are 
different due to errors there is no way of determining which one to use. In such a case, 
the reliability measure associated with each decoded TFCI could be used to improve the 
final decoded TFCI used to decode the actual block of data. This would further improve 
the BLER for longer TTIs where there is the probability of the loss of a large block of 

20 data. At the end of the longest TTI of data, we get 2 arrays, one corresponding to the 
decoded TFCI values and the other one corresponding to the Reliability numbers 
associated with each decoded TFCI. The TFCI to be used to decode the TTI of data is 
found as follows: 

25 TFCI = [TFCIi , , TFCIn], where N = TTI in ms/1 0 

Reliability = [Reliability Measure^ , Reliability Measure**], where N=TTI in ms/ 10 

1) Max_Reliability = maximum(Reliability Measure], Reliability Measure^, 

30 where N=TTI in ms /10 
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i = k, where Reliability Measure k = Maxjleliability 

Final_DecodedJTFCI = TFCIj 

5 2) Another approach could be to get the summed reliability measure for each distinct 
decoded TFCI hypothesis and choose the one with the highest total reliability measure. 
So in the vector TFCI: 

Choose the distinct TFCIs from the TFCI vector yielding: 

TFCI_distinct = [TFCI] TFCI M ], where M is the number of distinct 

10 decoded TFCIs 

forj = l:M 
fork=l:N 

if TFCI(k) = TFCLdistinctQ 
1 5 Total_Reliability(j) = Total_ReliabilityG) + Reliability(k) 

end 
end 
end 

20 Max_Total_Reliability = maximum(Total_Reliabilityi, Total_Reliability M ), 

where M is the number of distinct decoded TFCIs; 

i = k, where Total_Reliability k = Max_Average_Reliability; and 

Final J)ecoded_TFCI = TFCI_distincti 

25 Figures 7a - 7c show plots illustrating simulation results for TFCI decoding using 

various approaches for the reliability measure in association with a method according to 
one embodiment of the present invention. These simulation results are the results for 
various approaches to improve the TFCI decoding for TTIs that are longer than 10ms. 
Looking at the results, it is obvious that the best solution for short and long TTIs is to use 

30 the maximum summed reliability for each distinct TFCI decoded. 

When the code word space utilized is small, there can be significant power 
savings. The only hypotheses tested using decoder 100 were the ones known to exist, not 
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all of them, as is the case for the Green Machine or other conventional decoders. As the 
number of hypotheses to be tested decreases, the power consumption scales down as 
well. The present inventors found this is not an infrequent case at all, and will be the 
norm rather then the exception. This point is illustrated by the fact that for an AMR call 
5 in 3 GPP, the TFCS size is 8. In such a case, the decoder 100 has to test for only 8 
hypothesis instead of the possible 1024. Even in the case with a signaling channel in 
addition to the conversational channel and "Silence Indicator" (SID) and "no data", the 
TFCS size would be only 20. 

10 TFCI Decoding in 3 GPP Release 5 

The sparse decoder 100 can be easily modified to be used with hard-split TFCI 
decoding described in the Release-5 version of the 3GPP standard. The sparse decoder 
200 shown in Figure 9 can decode this flexible hard-split TFCI decoding in a single pass; 
whereas a conventional Green Machine has to run twice: one for DPCH with setting the 

15 received DSCH TFCI symbols to zero (puncturing) and a 5-bit TFCI for DSCH. In 

Release-5, this ratio may be different. Figure 8 illustrates the TFCI encoding procedure 
used in Release-5 for flexible hard split mode; and as stated herein before, can be easily 
implemented with the structure of the sparse decoder 200 shown in Figure 9 described in 
greater detail herein below. 

20 

Based on the size of the punctured code used, a subset of the basis vectors is 
chosen from that used for the normal mode. This subset is used in the Code Word 
Generator 104; and the rest follows as described herein before. Those skilled in the art 
will readily appreciate that although some additional control may be required, no major 
25 structural changes are necessary. 

The present invention is not so limited however, and although presented for a 
TFCI decoding problem, can be extended to other applications easily. This can be done 
in two ways. Firstly, in any application where the complete code word space is not used, 
30 we can improve the decoding ability. And secondly, we can design a longer block code 
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than is needed to get significant coding gains. Obviously this improvement is at the 
expense of bandwidth. 

It has been shown that the average probability of a code word error is bounded as 
5 follows: 

M 

p m ^ YjQ^ 2 yi> R c w m > where y b is the SNR per bit, R c is the code rate and w m is 

the weight of the mth code word. It is clear that as M, the number of code words 
decreases and as w m , the weight of those code word increases, the probability of a code 
10 word error decreases. Figure 10 shows the weight distribution for the (32,10) Reed 
Muller code. 

Two strategies were disclosed for improving a code's performance: When 
designing a new code the capability of the decoder can be improved by 1) making the 
15 code sparse; and/or 2) choosing the codes by using a Hamming distance approach for all 
code words. So only choose those codes that have the highest hamming distance from 
other codes and that would give a very powerful code by virtue of choosing the code 
words that are as distinct as possible. 

20 In view of the above, it can be seen the present invention presents a significant 

advancement in the art of error correction capability of block codes. Further, this 
invention has been described in considerable detail in order to provide those skilled in the 
decoder art with the information needed to apply the novel principles and to construct and 
use such specialized components as are required. In view of the foregoing descriptions, it 

25 should be apparent that the present invention represents a significant departure from the 
prior art in construction and operation. However, while particular embodiments of the 
present invention have been described herein in detail, it is to be understood that various 
alterations, modifications and substitutions can be made therein without departing in any 
way from the spirit and scope of the present invention, as defined in the claims which 

30 follow. 
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